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PROGRAM RECORDED THEREON 

(57)Abstract: 

PROBLEM TO BE SOLVED: To provide a supervisory system at a low cost, that is 
robust against environmental changes. 

SOLUTION: The supervisory system is provided with a means that enters an image in 
time series, a background image storage means that stores a plurality of images input, 
a different image storage means that calculates the difference between a plurality of 
background images of the background image storage means and a newly input image 
and stores the calculated differences, and a means that discriminates the presence of 



an intruded object by using the difference stored in the different image storage means. 
Since a plurality of background images can be automatically registered from a camera 
video image in an environment, where the environmental change such as an outdoor 
place is rapid, the robust supervisory system can be provided, which issues no wrong 
report, even if there are presence of the environmental changes such as shaking of 
trees, raining and snowfall, and reflection in a water surface. Furthermore, since a 
background image not in use can automatically be deleted, reduction in the detection 
speed and deterioration in the detection sensitivity can be prevented. 

* NOTICES * 

JPO and INPIT are not responsible for any 
damages caused by the use of this translation. 

LThis document has been translated by computer. So the translation may not reflect 
the original precisely. 

2.**** shows the word which can not be translated. 
3.1n the drawings, any words are not translated. 



CLAIMS 



[Claim(s)] 

[Claim 1]A monitoring instrument comprising: 

An input means which captures an image into a time series. 

A background image memory measure which registers two or more background images 
from a described image. 

A difference degree image storing means memorized in quest of the minimum (the 
degree of difference) of a difference absolute value for every pixel of the 
above-mentioned background image and a newly captured picture. 
A judging means which judges existence of an invading object based on the 
above-mentioned degree of difference. 

[Claim 2]A monitoring instrument, wherein the above-mentioned background image 
consists of a pixel value of the original number registered for every pixel in the 
monitoring instrument according to claim 1. 

[Claim 3]In the monitoring instrument according to claim 2, the above-mentioned 
background image, It is registered or eliminated for every pixel, and elimination is 
determined based on time after being referred to at time after this pixel is registered 



until it is referred to at the newest, and the newest until it continues up to the present, 
A monitoring instrument writing a new pixel value in this free space if the 
above-mentioned background image memory measure has free space when 
registering, calculating importance for every pixel value of a pixel which corresponds if 
there is no free space, and overwriting the lowest picture value of this importance. 
[Claim 4]a case where the above-mentioned judging means judges with "those with an 
invading object" in the monitoring instrument according to claim 1 — the above — a 
monitoring instrument having a memory measure which records a newly captured 
picture. 

[Claim 5]In the monitoring instrument according to claim 1, the above-mentioned 
difference degree image storing means, A minimum-value-pictures memory measure 
which memorizes minimum value pictures which consist of a difference absolute value 
for every pixel, A monitoring instrument, wherein it has an average image storing 
means classified by block which carries out block division of these minimum value 
pictures, and is memorized in quest of average value of a difference absolute value for 
every block and the above-mentioned judging means judges existence of an invading 
object based on a time series variation of the above-mentioned average value. 
[Claim 6]A recording medium with which a monitoring program executed by computer 
provided with an input output means, CPU, and a memory was recorded, comprising: 
A step at which the above-mentioned program captures an image into a time series 
from the above-mentioned input output means. 

A step which registers two or more background images into the above-mentioned 
memory from a described image. 

A step memorized in the above-mentioned memory in quest of the minimum (the 
degree of difference) of a difference absolute value for every pixel of the 
above-mentioned background image and a newly captured picture. 
A step which judges existence of an invading object based on the above-mentioned 
degree of difference. 

[Claim 7]A recording medium with which a monitoring program, wherein the 
above-mentioned background image consists of a pixel value of the original number 
registered for every pixel in the recording medium according to claim 6 was recorded. 
[Claim 8]In the recording medium according to claim 7, the above-mentioned 
monitoring program, Have a step which eliminates the above-mentioned background 
image, and in a this eliminated step. Based on time after being referred to at time after 
each pixel value is registered until it is referred to at the newest, and the newest until 
it continues up to the present, determine a pixel to eliminate, and in the 
above-mentioned step which registers. A recording medium with which a monitoring 
program writing a new pixel value in this free space if the above-mentioned 
background image memory measure has free space, calculating importance for every 



pixel value of a pixel which corresponds if there is no free space, and overwriting the 
lowest picture value of this importance was recorded. 

[Claim 9]a case where the above-mentioned judging means judges the 
above-mentioned monitoring program further in the recording medium according to 
claim 6 to be "those with an invading object" — the above — a recording medium, 
with which a monitoring program having a step which records a newly captured picture 
was recorded. 

[Claim 10]In the recording medium according to claim 6, the above-mentioned 
monitoring program, Have a step which memorizes minimum value pictures which 
consist of a difference absolute value for every pixel, and a step which carries out 
block division of these minimum value pictures, and is memorized in quest of average 
value of a difference absolute value for every block, and in the above-mentioned 
determination step. A recording medium with which a monitoring program judging 
existence of an invading object based on a time series variation of the 
above-mentioned average value was recorded. 



DETAILED DESCRIPTION 



[Detailed Description of the Invention] 
[0001] 

[Field of the Invention]This invention is concerned with a software program for a 
computer to realize the monitoring instrument used in the field of a supervising 
system, and this. Especially this invention provides low cost, a monitoring instrument 
robust to change of photography environment, and the software program that realizes 
this. 
[0002] 

[Description of the Prior Art]Now, surveillance with a camera is performed at places 
to reach, such as a road, a crossing, a public facility, a service floor of a bank, a 
convenience store, or an elevator of an apartment. The purpose of these surveillance 
is to perform previous prevention of an accident or a crime, and subsequent prompt 
treatment. 

[0003]In the supervising system of public facilities, such as electric power, gas, or a 
waterworks, two or more surveillance cameras are installed not only in indoor but in 
the outdoors. By this, the hitcher on can grasp the situation of the spot in real time 
with the monitor TV of a monitoring center. However, the work which continues 
looking at the image of two or more surveillance cameras over a long time causes a 
"oversight" etc. by fatigue. Then, only when required and an invading object and 
abnormalities are detected as a supervising system which can be checked with a 



monitor TV, the method of sounding and notifying a warning sound is generally 
adopted. There are a method of using various sensors, such as an infrared sensor, a 
door sensor, or a thermo sensor, and a method of analyzing the image of a surveillance 
camera directly in this detection. Although certainty is high, the former needs to 
install many sensors new in addition to a surveillance camera, and becomes a high 
cost. Since the installation of a special sensor of the latter is unnecessary, it is low 
cost. However, in the camera image of the place where an environmental variation like 
the outdoors is intense, since there is change of the image by reflection of a shake, 
rain and snow of a grove, and the water surface etc., there is a problem of outputting 
an alarm accidentally. 

[0004]For example, in the monitoring instrument of JP.5-14893.A, by comparison with 
the background image and inputted image which were created by data smoothing of 
the time direction, since an invading object is detected, when not changing a 
background, an invading object can be detected normally. Under the environment 
where the outdoor background is changed continuously, the problem of detecting 
superfluously is still left behind on the principle. 
[0005] 

[Problem(s) to be Solved by the Invention]As mentioned above, in the conventional 
monitoring instrument, when certainty was improved, it became a high cost, and when 
low cost was used, there was a problem that a false report increased. The issue which 
this invention tends to solve is in offer of a monitoring instrument robust to low cost 
and an environmental variation, and the software program which realizes this. 
[0006] 

[Means for Solving the Problem]A background image memory measure which 
memorizes two or more pictures inputted into a time series in order to solve the 
above-mentioned technical problem, A difference degree image storing means 
memorized in quest of the minimum (the degree of difference) of a difference absolute 
value for every pixel of two or more above-mentioned pictures and a newly inputted 
picture and a judging means which judges existence of an invading object using the 
above-mentioned degree of difference are provided. 
[0007] 

[Embodiment of the Inventionl Drawing 1 is a figure showing the principle of invading 
object detection of the monitoring instrument of this invention. Whether the invading 
object is reflected into the image of a surveillance camera memorizes the background 
image 1 74 in which the invading object is not reflected beforehand, it detects the 
changing image region as compared with the picture 173 inputted as this, and judges 
the existence of an invading object. In that case, the background image memorizes 
several kinds of patterns, and is made to perform comparison with all the background 
image of them, and an inputted image. For example, if the branch of the tree of a 
background may shake, several kinds of those patterns that shook will be memorized. 



Even if a wooden branch shakes by a wind by doing in this way, since those patterns 
are memorized beforehand, their either and inputted image of a background image will 
correspond. Therefore, although the wooden branch only shook and it tended to judge 
with those with an invading object accidentally conventionally, in this invention, stout 
invading object detection is attained to change of a background. 

r0008l Drawing 2 is an example using the monitoring instrument of this invention of a 
supervising system. The video signal from the surveillance camera 200 is inputted 
from the video input terminal 110 of the monitoring instrument 100, and is changed 
into a digital image. A digital image is displayed on the display 220 as an analog image 
from the video output terminal 110. When it judges with those with an invading object, 
the alarm signal emitted is sent to a monitoring center through a telephone line from 
the modem terminal 140. In that case, the cellular phone 210 etc. are available. The 
monitoring instrument 100 is controlled by the directions from a remote control via 
the infrared light sensing portion 1 30. 

[0009]As a surveillance plane machine connected to the monitoring instrument 100 of 
this invention as mentioned above, the conventional surveillance camera and display 
of an analog are available as it is. Furthermore, an alarm signal can be transmitted far 
away via a modem. 

rOOIOl Drawing 3 is one example of the system configuration figure at the time of a 
general purpose computer realizing the monitoring instrument of this invention. That is, 
the monitoring instrument of this invention is realized by executing a software 
program by a general purpose computer. 

[001 1]1 1 1 is an A/D converter which changes the video signal 210 from a surveillance 
camera into a digital image first. The changed digital image is incorporated into the 
video memory 118 at the same time it incorporates it into the memory 170 via the 
interface 1 1 2. 

[0012]The video memory 1 18 stores the picture displayed on the display 220 as digital 
data. 1 19 is a D/A converter of the kind currently generally called RAMDAC, reads the 
data written to the video memory 118 one by one according to scanning line speed, 
and draws on the display 220. Therefore, shortly after updating the data of the video 
memory 118, the contents of updating are reflected in the display information of the 
display 220. 

[0013]Even if it is a device for displaying a picture, for example, the displays 220 may 
be small CRT and a plasma display and are liquid crystal type display devices, they are 
not cared about. A continuous animation can be displayed on a display by repeating 
incorporation of such a picture by the frequency of about 30 seconds. 
[0014]The auxiliary storage units 160 are mass recorders, such as a hard disk, and are 
devices for recording digital data semipermanently. This may be a recorder of the type 
which can detach and attach only a recording medium like DVD-RAM and a flash 
memory in the ability to detach and attach the whole memory storage from a main 



part like the hard disk card of a PCMCIA method. 

[0015]CPU150 begins to control for invading object detection, and executes the 
software programs for realizing the function of the monitoring instrument of this 
invention. A program resides in the memory 170 permanently and the data which is 
needed for execution of a program is also stored here if needed. 
[0016]The modem 139 transmits the picture and alarm information which were 
recorded through a telephone line. The infrared light sensing portion 130 is an 
information input device from a remote control. Via the interface 131, input is given to 
CPU 150 and processed suitably. 180 is a data bus which connects mutually between 
each device described above. 

[0017]In the system configuration of the above monitoring instrument, in this example. 
By the invading object detection control program 1 72 first stored in the memory 1 70, 
storing the captured picture in the memory 170 as the inputted image data 173, it 
transmits to the video memory 118 one by one, and displays on the display 220. 
Furthermore, a picture is stored in the auxiliary storage unit 160 as recorded data 
after invading object detection processing if needed. When it judges with those with an 
invading object, an alarm signal is outputted via the modem 139. 

[001 8l Drawing 4 is one example of the remote control which gives directions to the 
monitoring instrument of this invention. All the directive commands from the remote 
control 400 are published via the infrared signal from the infrared ray emission section 
420. 410 is a button which directs ON/OFF of a power supply. The button in which 
430 directs detection of an invading object, the button in which 432 sets up the 
control parameter of invading object detection, the button in which 433 sets up 
various data, and 434 are the paddle switches 1 which choose an item, and it can push 
on the right-and-left upper and lower sides. 435 is the paddle switch 2 which sets up 
the numerical values from 0 to 9, when a top is pushed, it becomes a big value and 9 is 
a maximum. On the other hand, when the bottom is pushed, it becomes a small value 
and 0 is a minimum. 

[0019]Next, operation of the control-parameter setting button 432 and the detection 
button 430 is explained below. A push on the control-parameter setting button 432 
will display the control-parameter setting screen for the invading object detection 
shown in drawing 5 on the display 220. The background oblivion time input area which 
is time to eliminate the background that cursor registered 500 and the number input 
area of background images and 511 registered 510 in the figure, and 512 are object 
judged size input areas. 

[0020]The paddle switch 1 is operated, cursor is moved to the predetermined beam of 
the number input area 510 of background images, the paddle switch 2 is operated, and 
the desired number of background images is inputted. Next, if cursor is moved to the 
set area 530 and the setting button 433 is pushed, the number of background images 
memorizable to the maximum will be set up as a parameter. 



[0021]Similarly, the paddle switch 1 is operated, cursor is moved to the predetermined 
beam of the background oblivion time input area 511, the paddle switch 2 is operated, 
and desired background oblivion time is inputted. Next, if cursor is moved to the set 
area 531 and the setting button 433 is pushed, the shortest background oblivion time 
will be set up as a parameter. 

[0022]The paddle switch 1 is operated, cursor is moved to the predetermined beam of 
the object judged size input area 512, the paddle switch 2 is operated, and desired 
object judged size is inputted. Next, if cursor is moved to the set area 532 and the 
setting button 433 is pushed, the minimum object judged size will be set up as a 
parameter. 

[0023]If cursor is finally moved to the field 540 and the setting button 433 is pushed, a 
control-parameter setting screen will be completed. The monitoring instrument itself 
is equipped with a button or a paddle switch not using a remote control, and there is 
not a peach or ****. When a general purpose computer realizes the monitoring 
instrument of this invention, the function of each button and paddle switch may be 
assigned to the key of a keyboard instead of a remote control. 

[0024]A push on the detection button 430 will display the basic screen shown in 
drawing 6 on the display 220. It is a field which carries out the list display of the 
picture which 600 detected the viewing area of the inputted image, and 610 detected 
the invading object, and was recorded in drawing 6 , and the recorded picture 611 is 
reduced, put in order and displayed. In that case, the objective existence region 612 
and the detected time information 613 are also displayed. 620,630,640 shows the 
parameter set now for invading object detection, and, as for 620, background oblivion 
time and 640 are object judged sizes the number of background images, and 630. 
[0025]It is effective in the ability of the detecting situation of an invading object with 
the user from the present to [ a detecting situation / with this basic screen ] the past 
to grasp quickly. 

r0026] Drawing 7 is one example of the invading object detection control program 172 
for realizing the monitoring instrument of this invention. First, Step 900 is initialization 
processing and displays the basic screen of drawing 6 on a display. And the variable 
STATUS which controls the state of detection by Step 905 is reset to zero. 
[0027]And while the power supply of the monitoring instrument is on (Step 920), the 
following control management is performed. 

[0028]The state of the button of the remote control is first checked at Step 930, and 
decision processing of the following step 940 is performed. 

[0029]When the control-parameter setting button 432 is pushed, control-parameter 
setting processing is performed at Step 941. This processing is interactive processing 
with a user, a user operates the remote control 400 and a system inputs a numerical 
value, after displaying the control-parameter setting screen of drawing 5 on a display. 
After processing is completed, the display of a display is returned to the basic screen 



of drawing 6 . 

[0030]Next, decision processing of Step 950 is performed. 

[0031]The variable STATUS performs detection initialization processing 951, when 
the detection button 430 is pushed by zero. In detection initialization processing, the 
recording start date, the video recording start time, and the recording number N which 
are the header information of recorded data at the time of recording the picture in 
which the invading object was reflected are written in the auxiliary storage unit 160. 
The recording number is set to 0 at first. While initializing the frame number of an 
inputted image to 1, a picture is inputted from a surveillance camera and it registers 
as the background image data 174. The control data 176 for detection is set as an 
initial state further again. 

[0032]And one is set to the variable STATUS at Step 952, and it changes into the 
state under detection. 

[0033]When the detection button 430 is pushed by one, the variable STATUS 
performs Step 953, resets the variable STATUS to zero, and changes into the state of 
the end of detection. 

[0034]Next, by the decision processing of Step 960, when STATUS is 1, detection 
processing is performed at Step 961, and an alarm signal is outputted while writing a 
picture in the auxiliary storage unit 160, when an invading object is detected. The 
details of this detection processing are explained later using drawing 13 . Various kinds 
of data structures used by detection processing before that are explained. 
r0035] Drawing 8 is one example of the data structure of the recorded data 161 of this 
invention. Recorded data comprises a header unit and a picture part. The recording 
start date 161-1, the video recording start time 161-2, and the recording number 
161-3 are recorded on a header unit. The frame number 161-4, the image acquisition 
date 161-5, the image acquisition time 161-6, and the image data 161-7 are recorded 
on a picture part for every obtained image. 

r0036] Drawing 9 is a data structure of an inputted image and a background image. 173 
is an inputted image and a horizontal W pixel and length are H pixels. By the picture of 
the standard NTSC standard, W is set to 640 and H is set to 480. 174 is a background 
image. The background image 1 74-2 registers a maximum of K of the pixel value for 
every pixel of a position (i, j). The background registration frequency arrangement 
174-1 is arrangement which memorizes the number of times which registered the 
background-pixels value for every pixel. 

[0037]The frame number arrangement 174-3 at the time of the registration for 
memorizing the reference history information as a background image for every pixel 
and the newest frame number arrangement 1 74-4 referred to are provided. The frame 
number arrangement at the time of registration is arrangement which memorizes the 
frame number of the registered pixel value. That is, the time which registered the 
background image is managed. 



[0038]The newest frame number arrangement referred to is arrangement which 
memorizes the frame number of the pixel value referred to to the newest. That is, the 
time used at the end as a background image is managed. 

[0039]In this invention, since the reference history information on a background image 
is memorized for every pixel, registration and elimination of a background image can 
be finely carried out to a pixel unit. That is, in the photographing condition that only 
the part on a screen changes periodically, only the change part can be added as 
background parts, and can be registered, or can be eliminated. 

r0040] Drawing 10 is a data structure of the difference degree picture which consists 
of the minimum (the degree of difference) of the difference absolute value of the 
inputted image for every pixel, and two or more background images. 1 75-1 is a picture 
which the absolute value of the difference of two or more background images and 
inputted images becomes from the minimum which computed the value used as the 
minimum for every pixel. Thereby, a pixel unit understands the difference of a 
background image and an inputted image. 175-1-1 is minimum background number 
arrangement which memorizes a background-pixels number in case a difference 
absolute value serves as the minimum. The contents of minimum background number 
arrangement show which background pixels were most similar with the input pixel. If 
this is used, the reference history information on background pixels can update easily. 
[0041]175-2 is the average value picture classified by block which divided the 
minimum value pictures 175-1 into Q blocks wide and R blocks long, and memorized 
the average value of the value within each block Although Q uses 16 and R uses 12 in 
this example, it is not limited to this value. Thus, a block unit understands the 
difference of a background image and an inputted image by calculating the average 
value according to block. Since an invading object usually has a certain amount of size, 
detection capacity can be made more robust by judging difference rough to a block 
unit in this way. 

[0042] 1 75-3 is the varied region picture classified by block acquired by the processing 
which it will set to 1 , otherwise, 0 from a predetermined threshold if the average value 
picture 175-2 classified by block is size. The block which changed by this serves as a 
value of 1. 

["0043l Drawing 1 1 is the structure of the control data for detection. 176-1 is a FIFO 
type (fast in fast out) shift buffer which memorizes the average value picture 
according to block for a past M frame. It is referred to when analyzing change of the 
degree of difference for every block to a time series. 1 76-2 is a FIFO type (fast in fast 
out) shift buffer which memorizes the varied region picture according to block for a 
past M frame. 

[0044]176-3 is the coupled picture according to block which assigned the same label, 
in order that the value of the varied region picture 1 75-3 classified by block may 
distinguish each connected component for every connected component. 176-4 is the 



characteristic quantity table which memorized the upper left coordinates (XS, YS), 
lower right coordinates (XE, YE), and area of the bounding rectangle for every label of 
the coupled picture 1 76-3 according to block. It is decided [ an invading object or / 
whether other than this, the final determination of an or agrees on a standard 
predetermined in this characteristic quantity, and ]. 

r0045l Drawing 12 shows the example of the time waveform of the degree of difference 
of each block of this invention. Drawing 12 (a) is an example in case there is no 
structural change of a background, and a value with the small degree of difference 
continues. On the other hand, drawing 12 (b) is an example in case there is a 
structural change of a background, and a flat state continues with a value with the 
high degree of difference. The case where there is a structural change of a 
background is a case, for example, as the car came and parked a car at the place 
under surveillance. Although a car is not a part of background at first, after parking 
becomes a part of background. Thus, when a background completely changes with a 
former state, in this invention, an inputted image is newly registered as a background 
image. Drawing 12 (c) is an example in case there is an invading object, and the degree 
of difference serves as a value only with a high short time. For example, it is a case as 
people passed the place under surveillance. When the block which carries out such 
change is detected, some of number of times of change in the block and the breadth 
of a spatial change block are judged further, and it classifies into the periodic change 
of a background, and a true invading object according to this invention. 
[0046]Drawing 12 (d) is an example of the time waveform of block change when the 
background is changing periodically under the influence of a wind etc. In such a case, 
many change occurs for a short time. In this invention, when such a block is detected, 
this block is judged to be background parts to change, and the inputted image of the 
portion of this block is newly registered as a background image for every pixel. 
[0047] Judging with an invading object accidentally and continuing taking out an alarm 
with it, even if a shaking tree, reflection of the water surface, etc. are photoed with a 
surveillance camera by the function to register two or more backgrounds of this 
invention for every pixel is lost. Although the reference time range delta of past is 
carried out to for 2 seconds (i.e., 60 frames) (M= 60) in this example, it is not limited to 
this value. 

r0048l Drawing 13 is a flow chart which shows the details of the detection processing 
961 of this invention. 

[0049] First, a picture is inputted from the surveillance camera 200 at Step 1000, and 
it stores in the memory 1 70 as the inputted image 1 73. 

[0050]Next, at Step 1010, the absolute value of the difference of the inputted image 
173 and the background image 174-2 is calculated for every pixel, the value which 
serves as the minimum among all the background images is calculated, and the 
minimum value pictures 175-1 are created. The number of the background image 



which takes the minimum is stored in minimum background number arrangement 
175-1-1. 

[0051 ]And at Step 1020, the average value of the value of the minimum value pictures 
1 75-1 is calculated for every block, and the average value picture 1 75-2 classified by 
block is created. The created average value picture 175-2 classified by block is 
further transmitted to the shift buffer 176-1 of Step 1030. 

[0052]Next, the varied region picture 175-2 classified by block is created at Step 
1040. The details of this step are explained later using drawing 14. And the varied 
region picture 1 75-2 classified by block is transmitted to the shift buffer 1 76-2 at 
Step 1050. 

[0053]With reference to the data created at the above processing step, background 
image registration processing is performed at invading object decision processing and 
Step 1070, and Step 1060 performs background image erasing processing at Step 
1080. Finally one frame number is updated at Step 1090. 

[0054]In this invention, by processing described above, even if change arises for the 
background under photography with a surveillance camera, a background is updated 
automatically and it becomes stably detectable only about an invading object. 
[0055]Hereafter, Steps 1040-1060, 1070, and 1080 are explained still in detail with 
reference to drawing 14 , drawing 15 , drawing 16 , and drawing 1 7. 
r0056l Drawing 14 is a flow chart which shows the details of the varied region creation 
processing classified by block. Although this example divides the whole screen into 
QxR=16x12 block, when detection of a big object is the purpose, the number of 
partitions of a block may be lessened. The varied region creation processing classified 
by block is performing the following processings about all the blocks, and can be 
attained. 

[0057]The variable LIPPLE and the variable HEIGHT forjudging whether each block is 
changing first are calculated. The difference of the maximum of the block (i, j) within 
the shift section of the shift buffer 176-1 with which the average value picture 
classified by block was stored at Step 1110, and the minimum is calculated, and it 
stores in the variable LIPPLE. Next, the value of a block (i. j) of the average value 
picture 1 75-2 classified by block of the present frame is stored in the variable 
HEIGHT. 

[0058]And the variable HEIGHT (block average value of the present frame) judges 
whether the variable LIPPLE (difference of the maximum of the block average value 
within the shift section and the minimum) is larger than threshold th2 predetermined 
at Step 1120 more greatly than threshold th1 predetermined. If all are large, it will 
judge with the state which showed in drawing 12 (c), and 1 will be set as the block (i, j) 
of the varied region picture 1 75-3 classified by block at Step 1 1 25. On the other hand, 
if either is also small, 0 will be set as the block (i, j) of the varied region picture 175-3 
classified by block at Step 1 1 30. Although th1 and th2 is 5, even if it uses other values, 



there is no **** here at this example. The range which the value of a pixel takes is 0 
to 255. 

[0059]The variable HEIGHT judges whether the variable LIPPLE is smaller than 
threshold th2 predetermined at Step 1132 smaller than threshold th1 predetermined. 
If all are small, it will judge with the state which showed in drawing 12 (a), and the 
update process of the reference history information on the background image of Step 
1 1 35 to the step 1 1 55 will be performed. 

[0060]Step 1 135 calculates the range of the address on the actual picture of a block (i, 
j). And the reference history information on the background pixels referred to is 
updated about the background pixels within a block. 

[0061]First, the value of the point 02, j2) of the step 1150 minimum background 
number arrangement 175-1-1 is assigned to the variable k. Next, the point 02. j2, k) of 
the arrangement 174-4 which recorded the newest frame number referred to at Step 
1 1 50 is updated to the present frame number. Thus, in this example, when the picture 
and background image which were inputted now are in agreement as a block, the 
reference history information on the background pixels within all the applicable blocks 
is updated. 

r0062l Drawing 15 is a flow chart which shows the details of the decision processing of 
the existence of an invading object. 

[0063] First, the coordinates and area of a bounding rectangle which enclose, 
characteristic quantity, i.e., an invading object, required in order to detect the field of 
an invading object, are determined. Therefore, in Step 1200, about the block of 1, the 
value of the varied region picture 175-3 classified by block judges with the connected 
same ingredient, when the block of the left, the right, a top, or the bottom is 1, it 
performs processing which gives the same label, and creates the coupled picture 
176-3 according to block. And at Step 1205, a bounding rectangle and area are 
determined for every connected component of the same label of the coupled picture 
1 76-3 according to block, and it stores in the characteristic quantity table 1 76-4. 
[0064] Next, the existence of an invading object is investigated at Step 1 230 from Step 
1210. The variable FLAG is first reset to zero at Step 1210. When this FLAG changes 
with subsequent processings to 1, it judges with an invading object existing. About all 
the labels, processing of Step 1220 to the step 1230 is repeated. In Step 1220, the 
bounding rectangle coordinates and area of the label i of the characteristic quantity 
table 176-4 are read, and it sets to the variable XS, XE, YS, YE, and AREA. And when 
the conditions of x(XE-XS+1) (YE-YS+1) >th4 and AREA>th5 are judged at Step 1225 
and conditions are satisfied, the variable FLAG is set to one at Step 1230. 
[0065]Since invading objects, such as human being, differ in the character of shape 
from invading objects, such as a branch etc. of the tree which shook, both features 
are used for having judged both the size of a bounding rectangle, and the size of area 
by this example in order to distinguish those differences. Here, since the concrete 



value of threshold th4 and th5 changes with invading objects which should be 
detected, the user sets up the suitable value beforehand. In this example, th4 and th5 
is 2. 

[0066]Finally it judges whether the variable FLAG is 1 at Step 1235, and, in the case 
of 1 , processing at the time of those of Step 1 240 to the step 1 255 with an invading 
object is performed. At Step 1240, the one recording number 161-3 is updated. And 
the present inputted image 1 73 is written in the auxiliary storage unit 1 60 as recorded 
data with a frame number, an image acquisition date, and image acquisition time at 
Step 1245. Next, the inputted image 173 is reduced at Step 1250, and it displays on 
the display 220. In that case, the bounding rectangle surrounding the invading object in 
a picture may be indicated by overwrite, and detected time may also be displayed 
further. If it displays in this way, the detecting situation of the invading object which 
went back to the past from the present can grasp a user in an instant. At Step 1255, 
an alarm signal is further outputted outside via the modem 1 40. 

r0067l Drawing 16 is a flow chart which shows the details of background image 
registration processing. Background image registration processing is performing the 
following processings about all the blocks, and can be attained. The variable LIPPLE, 
the variable HEIGHT, and the variable SUM forjudging whether each block is changing 
first are calculated. The difference of the maximum of the block (i, j) within the shift 
section of the shift buffer 1 76-1 with which the average value picture classified by 
block was stored at Step 1310, and the minimum is calculated, and it stores in the 
variable LIPPLE. Next, the average value of the value of the block (i, j) within the shift 
section of the shift buffer 176-1 is calculated at Step 1315, and it stores in the 
variable HEIGHT. 

[0068]Total of the value of the block (i, j) within the shift section of the shift buffer 
1 76-2 with which the varied region picture classified by block was furthermore stored 
at Step 1320 is calculated, and it stores in the variable SUM. 

[0069]Next, the registration condition of a background image is judged at Step 1325. 
The conditions of registration are with two, one is HEIGHT>th1 & LIPPLE<th2, and it 
is a case where the situation of drawing 12 (b) is detected. Another is SUM>th3 and is 
a case where the situation of drawing 1 2 (d) is detected. The former is a structural 
change of a background, for example, a situation which the car has newly parked into a 
background corresponds. The situation where the latter is a periodic change of a 
background, for example, the wooden branch is shaking continuously by the strong 
wind corresponds. If such a situation is detected, in order to newly register a 
background image, Steps 1230-1370 are performed. In this example, th3 is 30 here. 
The reference time range delta of past is a value for 2 seconds, i.e., when referred to 
as M= 60, and this means detecting the situation where the past not less than 50% is 
changing. 

[0070]Step 1330 calculates the range of the address on the actual picture of a block (i, 



j). And only when the degree of difference is remarkable and large about the pixel 
within a block, the pixel value of an inputted image is selectively registered as a 
background image for every pixel. 

[0071]The value of the point 02, j2) of the minimum value pictures 175-1 of a 
difference absolute value is first set as the variable DIFF at Step 1345. Next, it is 
judged at Step 1350 whether the variable DIFF is larger than th1. Since the pixel of 
the inputted image differs from every background pixels registered now when large, 
processing of registration of the background pixels of Steps 1355-1370 is performed. 
[0072]The number of the registration portion of the background as for which the point 
02, j2) of the background image 174-2 is vacant at Step 1355 first is set as the 
variable k. Next, one value of the point 02, j2) of the arrangement 174-1 which newly 
registers the pixel value of the point 02, j2) of the inputted image 1 73 into the point 02, 
j2, k) of the background image 174-2 as background pixels at Step 1360, and records 
background registration frequency at Step 1365 is updated. The present frame 
number is written in the point 02, j2, k) of the frame number arrangement 1 74-3 at the 
time of registration, and the newest frame number arrangement 1 74-4 referred to for 
initialization [ at the last ] of the reference history information on a background at 
Step 1370. 

r0073l Drawing 17 is a flow chart which shows the details of background image erasing 
processing. This processing is processing which eliminates dynamically the 
background image used no longer contrary to the processing which registers 
dynamically the background image explained by drawing 16. By this processing, 
memory space required for a device is lessened and the computation time which 
invading object detection takes can be shortened. Degradation of the detection 
sensitivity by memorizing the background image of unnecessary a large number can be 
prevented. 

[0074] First, processing of Step 1410 to the step 1450 is performed about the pixel of 
all the background images. In Step 1410, the value of the point (i,j) of the background 
registration frequency arrangement 174-1 is set to the variable n. And subsequent 
processings are performed to 1 to n times about the variable k. 

[0075] At Step 1420, it is judged first whether the value of the point (i,j, k) of the frame 
number arrangement at the time of registration is one or more. The case of one or 
more judges that background pixels have not been eliminated yet, and performs 
processing from Step 1 425 to Step 1 450. At Step 1 425, the difference of the value of 
the point 0, j, k) of the newest frame number arrangement 174-4 referred to and the 
value of the point (i, j, k) of the frame number arrangement 174-3 at the time of 
registration is calculated, and it stores in the variable EVAL The value of this variable 
EVAL is the period when applicable background pixels were referred to. In Step 1430, 
it judges whether the variable EVAL is smaller than threshold th6 predetermined, and 
if small, threshold th6 will be written in the variable EVAL at Step 1435. Threshold th6 



can set up any value here. If it sets up for a long time, it is possible to memorize as a 
background for a long time. In this example, th6 is set to the value of the frame 
number of sheets equivalent to about 10 seconds, i.e., 300. When the variable EVAL is 
smaller than threshold th6 predetermined, threshold th6 is written in the variable 
EVAL, in order that a reference period may not eliminate a short thing immediately. 
[0076]Next, the difference of the present frame number and the value of the point (i,j, 
k) of the newest frame number arrangement 1 74-4 referred to is calculated at Step 
1440, and it stores in the variable PERIOD. This variable PERIOD is a period which is 
not referred to by the present. 

[0077]It is determined whether importance at present should be judged and eliminated 
from the function which made the variable two, this period EVAL referred to and the 
period PERIOD which is not referred to. Although judged by whether (PERIOD-EVAL) 
is positive at Step 1445 in the example, it may judge by whether (PERIOD-EVAL/K) is 
positive as another judging standard. K is a constant here, and it should eliminate — 
when it judges, the value of the point (i, j, k) of the frame number arrangement 174-3 
at the time of registration is reset to 0 at Step 1450. It means that applicable 
background pixels were eliminated by this. 
[0078] 

[Effect of the Inventionjln this invention, since an invading object is detectable from 
the image of a surveillance camera, it is not necessary to install a sensor new in 
addition to a surveillance camera, and is effective in the ability to provide a low cost 
monitoring instrument. From the camera image of the place where an environmental 
variation like the outdoors is intense, since two or more background videos can be 
registered automatically, it is effective in the ability to provide the robust monitoring 
instrument which does not take out a false report even if the environmental variation 
by reflection of a shake, rain and snow of a grove, and the water surface etc. occurs. 
Since the background image used no longer is eliminated automatically further again, it 
is effective in the ability to prevent the fall of detection speed, and degradation of 
detection sensitivity. 



DESCRIPTION OF DRAWINGS 



[Brief Description of the Drawings] 

[Drawing 1] It is a figure showing the principle of invading object detection of this 
invention. 

[Drawing 2] It is an example using the monitoring instrument of this invention of a 
supervising system. 

fDrawing 3] It is a system configuration figure of the monitoring instrument of this 



invention. 

fPrawing 4] It is one example of the remote control of this invention. 

fPrawing 5] It is one example of the control-parameter setting screen of this invention. 

fDrawing 6] It is one example of the basic screen of this invention. 

fPrawing 7] It is a flow chart of the invading object detection control program of this 

invention. 

fPrawing 8] It is one example of the data structure of the recorded data of this 
invention. 

rPrawing 9] It is one example of the data structure of the inputted image and 
background image of this invention. 

rPrawing10] it is one example of the data structure of the difference degree picture of 
this invention — it comes out. 

fPrawing 11] It is one example of the control data of this invention. 

fPrawing 12] It is an example of the time waveform of the degree of difference of this 

invention. 

fPrawing 13] It is a flow chart of the detection processing of this invention. 
fPrawing 14] It is a flow chart of the varied region picture creation classified by block 
of this invention. 

fPrawing 15] It is a flow chart of the invading object decision processing of this 
invention. 

fPrawing 16] It is a flow chart of the background image registration processing of this 
invention. 

fPrawing 17] It is a flow chart of the background image erasing processing of this 
invention. 

[Pescription of Notations] 

100 [ — Video memory, 1 19 / — A P/A converter, 120 / — A video output terminal, 
130 / — An infrared light sensing portion, 139 / — A modem, 140 / — A modem 
terminal, 150 / — CPU, 160 / — Auxiliary storage unit, ] — A monitoring instrument, 
1 1 0 - A video input terminal, 1 1 1 - An A/P converter, 1 1 8 1 70 [ - A cellular phone, 
220 / — A display, 400 / — Remote control. ] — A memory, 180 — A data bus, 200 
— A surveillance camera, 210 
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T?fcSo 

[0038] #BH*nrc««fo7U-^#^swtt, a 
-ea&So t&^is. «jRB«^bT«Sk*cflet?nfc«PM 

[0 0 3 9] *^ftt, W»B«o#fK«aHW8*±B 
JRfffcEltLT^S©"?. WKBfiSoea-^JBSttB* 
¥ffi&cfflfr<fT*£o *r&fc>*5. Bffi±<D— 8te)^:W 

So 

[0 0 4 0] Hi 014, BSfccTfc^ A^Bff £&2&<9 

ssftof-i'SiiTfeSo i75-i ««»<o«* 
b^ t \jimvk<og(Dfbitfawwi'^t. * s fB^B^ft ^ 

HtajL/ft«/h«*^6*«B«T**o cntc^D, BJ^ 
*ffi[fcWRB«fcA*B«Offla^fc*^o 17 5-1 
-lfci\ a»«3*«^«/hfca:Si:*0««B*#%* 
IBH^ S «/JM»»SMHtE0J T* « * o «/h«HH«E 
5iJ^rt^c<fct). H<D«*B*^A*B*4:«fe»(HL/ 
T^ftfr**fr8o cn^fflMi:, #»B*E>#K8fiI 

[0 0 4 1] 175 -2tefi/JvMB« 175-1 



(5) M2 0 0 1 - 1 8 6 5 1 1 

7~n*y^, ffiR:/n*y ^C^f'JU &7uv?ft<Dm<D 
¥i^«*E1tbft^py*gy¥*9fllB«t?**o 
0J-ettQtt 1 6, Rt±l 2*ffiffl-r**^ c^fBtcpg^ 

■TScfc-e. «BttllS*J:On;WHL«e:tff« 

So 

70 [0 0 4 2] 1 7 5-3tt7ny*gW*5«B«l 7 5 
-2tff3!fi£<OM«<fc DA^fetitf 1 , *576»nB0 

£>S 0 c:nk:J:!?*fkUfc^oy*ttiofilfc*So 
[0 0 4 3] El 1 1 t±^ffiO/'c«)0©JfliT f --^<0«iST 
£>S 0 1 7 6- lliIiM7 \s—b&Wuy>?'ti\<W 
i%mm&%&W&%>F I FO§!i (fast in fast out) <D 

s{fc*j»w?"s *«, 1 7 6-2ti}iSM7 

i/-A»©^Dy^aijo«{tw*B»*E« , r*F 1 f 

20 0§y (fast in fast out) O^7h^777T'^ 0 

[0 0 4 4] 1 7 6-3tt^P*y*»J«ft««B«l 7 
5-3 ©ffitf 1 (DW&lSftm^ ffl^Oattfi8»*KB'J 
■TSfcfeH— co^/t/^rSJS STfe^D *y ^SUittfiBtt 
T'feSo 1 7 6-4te7*P*y ^£<J3i*SMt 1 7 6-3<D 
^/^ftfcfl^#»©;fc±tf« (XS, YS) , 

mm (xe, ye) iitraf«*E«b^»«ui'r-^i/ 

[0 0 4 5] HI 2tt*S5MO«^D'y*<OfflafiO«F 
30 Biffifg©e«*^-fo H12(a)tt««©«ifiaS{t36^i/^it 
^cO^jr^D, ffiMJg^h£Wfi*%Ko -75". 012 
( b ) ttW«0«JB«fk****«^0«IT« 0 , fflBSte 

fcSofc<at>ofc»&. *«RBT*«A*B«*»fftK: 
WiftkbtaSfio H12(Ott«AWftt***« 

K^A^^^-TSo 
[0 0 4 6] B12(d)tt»ftHO»»TW*^«JHWte 

s 0 *m%^i±z<D£?r£7tiy 5%&&isrzm'£, c 

50 ^o^OA*H«*ia*c:i:tcffrctcW*fi«i: LT 
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[0 0 4 73 *5IBB©a»0«**iBIR«fc»»t-a« 

ftgtc cfcoT, jsn^>*^7j<ffios«-^ h # ksi* * 77 s 

ttSfc^dcfc*^<ftSo 413. 

#fia«PM(BH 5 tt2»H'rftto*6 607 V-L>tt (M = 

6 0) ^LTl/^ft C©»cH^*tlSfe<0"Cttft 

coo4 8] 01 3t±*»wo«iaifflia9 6 1 (omm* 

[0 0 4 9] S-T. Xfy7l 0007E?W^720 
0fr&B«*X*LT. A*lfi« 1 7 3 fcl/T^U 1 

7 oicmmrzo 

[0 0 5 0] atxf7^i 0 1 0t\ A^Bitl 7 3 
^ffidi 7 4-20M5T^I&ttffi ; £B^^S+^ 

«/jNffia« 17 5-1 *fNtf£o Sfc, */htt*i:S 

»*H«o»«*«/J^w***^J 1 7 5 - i - 

[0 0 5 1 ] fLT, Xf7^1 0 2 0T, 7ny 
icS/JvtliBft 17 5-1 ©ffitf)¥*3ffi*ftWU ^ 

2%\i¥i%mmm 1 7 5-2tisetxfy7i 0300 

5/7 h^777 17 6-1 ^Iej^'T^o 
[0 0 5 2] WcTsTVfl 0 4 OT^ny^giJgffcffi 
ttBftl 7 5-2*fWT*o COXf^Offatt, 
«-CHl 4tffl^TWBf*. ^ttXf^l 050 

1 7 6-2^\$^f^o 

[0 0 5 3] i^±^^IXx^7°^{^brc-r-^^# 
1LT, Xfy^l 0 6 07?flXft«*]£»i, Xf7 

y i o 7 o 7?tt«B«s»«yi. xf7/io8 0Tf 
*B«»*ftia*fT5o i^xf-yyi o qowu 

[0054] w±5E^fejaafc«fcoT 1 e 

C0 0 5 51 WT. Xf-y7l 0 4 0, 1 0 6 0, 1 0 
70, lOSOtCO^T, 014, 015, 016, 0 

[0 0 5 6] 0 1 4«7 r n^*S'JS{l:SH«fffiK«3 ! a^l¥ 

QXR=16Xl2^P'y>lC»««tf, *Sft1*M* 

[0 0 5 7] $-T#^ny ^*WbbT^Sft^5fr* 

wjersfeftoaasL i ppleote i ght* 

ItHT^ Xfy^l 1 l 0T*7ay*SWi3ffiB«tf 
♦S3W*nfc^7 h/^777 1 7 6— 1 ^^>7 hEP^FSlO 



(6) 2 0 0 1 — 1 8 6 5 1 1 

JO 

giJ¥±MB« 1 7 5-20yP7^( i J)Offl*S»H 
E I GHTfctelfrrSo 

[0 0 5 8] ^LTXf7yi 1 2 0T?S»HE I GH 
T (SHE 7 >y ^¥^ffl)^RFf^^B9fifi t h 1 

^^^<, fro, S»L I PPLE(^7hKIBrtO 

h2j:D*S^H5fr* ! PKtSo feLfev^tlfe* 
;o Sltntf, 012 Cc) fcjSLfcttttfcfflSL, Xx*y 
7*1 1 2 5T?^ay^BiJSMt««B» 1 7 5-3^7n 

y*(ij)fci«iBrr*o vvrn*^fc/h«tt 

*Uf, Xf-y^l 1 3 0T^a->^gUSefk««B«l 7 
5-3©7*n7^(i J)^0^t^o cl C 7?*^fifi 
fflj7?ti. thltth2^5 Tfe3fr\ ffi<0{B£:ffl^T 
fcjW3*ftl/\i B*D«tffc5IBHtt0fr&2 5 

[0 0 5 9] £fcXx>y:/l 1 3 2"t?S»HE I GHT 
tffifi£<DKKB thU < , fr-o, ISLIPPL 

fcfU^U Xf77 P l 1 3 5^^X7-77^1 15 5©f 

[0 0 6 0] X77/113 5\Z7vy>7{ i ,'})(D$m 

>y ^ ft offlltc ot^T, #SS 2 nfc »SB*©#fH 

[0 0 6 1] S-f, X77^1 1 5 0Jft/hffi«»*tK 
Wl 7 5-l-l^(i 2 J2)©ffi*£»kEttA-r 
J0 & 0 »CXr7 7"l 1 5 0 7?#8g£nfc«#rO7l^— A 
##*IB»bftBEJ>J 1 7 4 — 4<D;£ ( i 2, j 2, k) £ 

tt. SfiEA*UfeB«fc**B«*^o^^i:bT-a 
Lfe#&, Kit St^TO^n 7 

[0 0 6 2] 0 1 5 lZ®Xto#<D&MOW7£.9BM<Dmm 
^t7P-ft-ftJ)§o 

[0063] s-r. «x**o«***tat"*fe** c * 

40 «fcffi»*#«)So WftftlCXryyi 2 0 07?«, 
:/n*y*giJg{fc«J*B« 1 7 1 <07P'y * 

tcov-T, 6. ±x SftttWny^ffiOid 

-TSo ^1^X7771 2 0 5^, 7ny*giJiII6B« 

«£3}<#), #a»f— 7 6 — 4tCt§*fi*r^o 
[0 0 6 4] ^tcX-T7 7 P l 2 1 0^6Xfy^l 2 3 
0T*«X«f*©W*R*WI^So ^fX777l 2 1 07? 
50 gftF LAGSOlcU-fey htSo C <E> F L A G 
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II 

commie £ r>r ucmkisfctif. «AWf*##«rt"*fc 

JpKtSo ^T<Dv^/WCO^T, 2 2 0 

^Xfy^l 2 3 OeDSaa** 55I^o Xf7/12 
2 0Tii, ^Hif"7;H7 6-4(D7^i^ 
ft#«tf*fcffi**tt#WU ^SXS,XE,YS,Y 
E, ARE Atc-t^y htSo fbTXr^^l 2 2 5t? 
(X E-X S+ 1 ) X (Y E-Y S+l)> t h 4 fro ARE A> 

1 2 3 0T?S»F L AG* lfc-fe'V h^So 

[0065] xmutrnv, ftm&m2<o±%'Z£tffim<D 

Tt^o lCT, KHiIth4, th5£DlW%»^ 
-f«ltfe<o *^«8«T-tt t h 4 fc t h 5 fe 2 

So 

[0 0 6 6] iSKXfy^l 2 3 5T»fflRFLAGtf 

S D Xf7^1 2 4 0T*tt»Bffl»l 6 1— 3*10^ 
#rTSo ^lt, Xr^yi 2 4 5T^*E^A^B«1 
7 3^7U-AS^, fiflMMM^B. Bff^fi^'J^ 
J:fcK:gBx-*£LT«ttE1)i8«l 6 0tc«^?i 
Cfo ^^Xx^7°l 2 5 0TA*B«1 7 3«:«S/hLT 

B Stoic 2 fr<DC3f o /c{lAWf*^^ttittW^-* 

So 

[0067] 01 6 ttw«H«a«Baow«i*^-r7 

So Sf*^P7* S^lk b T ^ S E o * S 
L I P P LE^SHE I GHTkSSS U 
MfctUTTSo Xf77°13 1 0-P7oy*9ffi^«l 
«tf«»Snft^7 1 7 6— 1 (0^7 VEf 3 ^ 

fl©7P * * ( i jjoftfclifca/JMItoMftttlll/T, 

^SSCL I P P L EtCtSfflTSo ^Xf77 P l 3151? 
^7 h^777 1 7 6— 1 <E>^7 hEHrt07"n v 
(i,j)Ofi^¥^Jfa*ff^UT, S»HEIGHTt« 
ffnTSo 

[0 0 6 8] S6fcX-ryy 1 3 2 OT^D^^giJ^ft 
W»tfi«lSnft^7h/Vy77 1 7 6-2^>7 

[0 0 6 9] *tXf7^1 3 2 5T*««B«E>SS£ 
fWKtSo SS^)^fft±2oWD, -Oli, HE I 



(7) #112 0 0 1 - 1 8 6 5 1 1 

72 

GHPthl & LIPPLE<th2tf«9, Bl 
2 (b) ©tt»*#ffiLfc*&"C&*c fe5— Ott. S 
UM>th3TS^ 012 (d) ©ttM*4«BLfc» 

^Xry^l 2 3 0*^1 3 7 O^Rt^o CCT* 

si«t«-ei4 th3(±3o -rfeSo etui, a*o#saw 

D, IS 5 0 %lX±^t LTt^«^ffit^ c 
[0 0 7 0] XT7/1 3 3 0ti^n>y ^( i , j)C0*B 

§rrs 0 

[0 0 7 1] Sf Xr^^l 3 4 5Ti»«»(IOi'J> 
20 {BBft 175-1^ (12J2) <Dffi*g«D I F F 
tcS^So *lCXfy^l 3 5 I FF^t 

h l * 0**^**2 5 fr«£**o *#^»£tt9iftS 
BSnt^S H(7)ffBi^ fcA±rB«<DBMItfK&o 

Tl/^OT, XT7^1 3 5 5*>e> 1 3 7 O^fiBi 

OSBoaQS^ffT S o 
[0 0 7 2] ^fXf77 P l 3 5 5TitSBflU 7 4 — 
2cD,£ (i 2,}2)(D&^X^%>1$m(D&»ffitt(D&^ 

SrffiftkkiHS'rSo ^Xf^yi 3 6 OTflBi 
174-2^ (12J2, k)tCA*B«l 7 3^S 
30 (i 2j2)OH««*fffcteW«S*kbT««U 

xr77 , i 3 6 5 ■c»*s»0R*ie»r5e$u 1 7 4 

— \<D& (i 2,j2)cD{if£: l^Ift^o »»^^«r 
7^1 3 7 0T, W«cD#fH«K*«<0SJKB{bOfc«). 
SSe©7U-AifE?iJ 17 4 — 3 £#Kl2ftfc«#f 
07U-A#^@B?U 1 7 4-4(0^ ( i 2 , j 2 , k) 

[0 0 7 3] 0 1 7 tt»*Bt«aMO»«*^t7 

u-^^—vxh^o ccommz, hi 6T?mBabfeW 
«A^#«ui^s , rstfw^FM^ja«T?**o *fe, ^ 

[0 0 7 4] -r^TOWRBflfcOBJR^Ol/^T, 
Xf'y/l 4 1 0^6>Xf77l 4 5 0«Mifft 
So Xf77l 4 1 0T«, WHMElBfflBMl 7 4 — 

k fcOVT 1 6 nSft^MI^Tt^o 
50 [0 0 7 5] SfXf7yi 4 2 0t, gBf$<D7U- 
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Sff07U-A#^IB?Ul 7 4-40S (1 J. k) <0 
ttfc«S»(07U— A##HB?IJ 1 7 4 — 3©^ (i J, 
k) offlogfctmu «»EVALte«tt-r*o 
S»E V A LO*tt«a^*W*lii*^#i!SSnfc)«IB 
■CfcSo Xf7^ 1 4 3 0 THiiaE V A L«^H 
{fit h 6ctO/hS^H-5^J^U fcUhStffttf. 
X-r^7°l 4 3 5t?BB«t h6*SE»EVALfc:«*i& 

A LtfHfi&DBMI t h 6 cfcO^^^fcSfcx Mt h 6 
*K»E V A LK:«*5&tWl±> #IH«BBA^®V>feO* 

[0 0 7 6] »CXf7^1 4 4 0T«©7WAS 
^fc#BH«tlfc««f©7U-A»«EWl 7 4 — 4<Dj£ 
(i f j,k) Ofi^tWU ggRPERIODK* 

[oo77] c o#sa« nfcffiiH e v a l fc#aa« nt 

^«PE R I 0D£>2o*a»i:LfcM»fr6S 

3o SlfflCTWiX-r^yi 4 4 5t (PERIOD-E 
VAL) tfjEfr£3fr^*JSbT^S*\ gijO^J^S^P 
^LT, (PERI OD-EVAL/K) #IEfr25**T? 

^Sfcfflj£l,fc»&* Xf7/1 4 5 0TfMW©7l/ 
-AS^SB^iJ 1 7 4 — 3^^ ( i , j, k) ©ffifcOfcU 

[0 0 7 8] 

wksst *vwsn, m^s, ;j<fficoRS^ 



»M 2001-186511 
14 

[0 1 ] *^<Df!AWffl^JSI^^tiTfe^o 

10 [0 3] *%0^^Igt^*>XfAM0T^§o 
[0 4] ^0^cDU : e=i>'O--^SS^J^fe ; ?>o 

[0 5] *»wo»W/<5^-#IBEliffi©-^*«^ 

[0 6] *f|0^a*iij®o-'*ffi^ | J^^^o 

[07] ^B^OfSAft^mM^n^^AcD^n-- 

[0 8] *^OSlBx-^Of ? -^eii§0-*flfie>Jr* 

[0 9] *^^A^PJfS^WMS^x--^«}tC)- 

[01 o] ^mfivm^&mm^-zm&tD-^mm 

[011] &mR<offlfflT—$<D-'MMm'V2b%o 
[012] ^m<Dmm&<o^mm&<ow\^& : &o 

[0 1 3] *»tffll^7D-f^-bT^§ 0 

[01 4] *«M©7ny^iJiJ«{t««B«ff«©7a 
[01 5] *^OgAWMI^7P»-f^-b 

jo [01 6] *«^ow«iB«e»jaa^^o-^^-h 

1 0 0-Effl8i, 1 1 1 1 l" 

A/DSSSS. 1 1 S-Hft^t'J, 1 1 9-D/AS» 
g§, 1 3 0-#*H*»tt«. 

14 0-tfAiST, 150-CP 
U, 16 0-WUemi. 17 0-^'J, 180- 

40 =f— tutx, 2 o o-e&a*^. 2 10-mss, 
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(9) 



2001-18651 1 
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(10) 



2 0 0 1-18 6 5 1 1 



[05] 

125 



500 




511 



SET 



512 



^XZDLEI l sirr 



220 





EXIT 



531 



532 



540 
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172 



STATUS- Q 



[07] 



■ 7 



J. 



830 



940 



I 



r 950 



STATUS=0*C 

fc*? 

STAT0B=l*eK 



,960 



STATUS = 



I 



H8 



[08] 




6TATOS=0 



I* 



963 



951 



N 
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U/ 181-1 
161-2 



— ^v/ 161-3 



.161-4 



2 

^ 161-5 



161-6 



— 161-7 
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(11) 



ftffl 2 0 0 1 - 1 8 6 5 1 1 
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(12) 



4$Bfl2 0 0 1 - 1 8 6 5 1 1 
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LABEL<i>j) 



FEATUE£(5, label) 



1 2] 



A 
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Te-<5 tc 
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(13) 



2 0 0 1 - 1 8 6 5 1 1 



im 1 3] 



[0 14] 



■ i a 



1B40 



HI 4 



1006 



ArtM 1 ? 3 h Lxy * U 1 7 0 CUHA 

t* 



1010 



XAil 1 7 3 ***** 17 4-2 *5£Sf 5? U < 
7 5-1-1 Cttttr t. 



a'jvtmm 175-1 ©tttre -> 

*U ^oy»W¥J&*S*17 5-2*f*4rT*. 



I* 



7*n**WWMWl 7 5-2**7 j>/t* 



102C 



1039 



70 * * W*fc*«M*frtf»31 



17 6-2^«St*. 



107fl 



7U-A«* < 



10M 



1100 



5-1,1 



1105 



1120 



HE I GHT>t h 1 
fro 

LIPPlB>th2 



HE I OHT<th 1 / 
*o / 
LIPPLE<th2\ 



1110 



S"7 h«?77 17 8-1® 
*7 MZWW07-D* *<i ( j) 

#U-C, jfeftLIPPLEt 



1U5 



7P#i»HTOW«l 7 5-2<D 
7as/i'(l < J)4Hl«**HE IQHT 



7n**S*fc«*W*17 5 



-30 



7D**sl*Hh««p*l 7 5-3 



1130 











is « 


(i-l)ftxU 


U ■ 


li+la-l 



I* 



1136 



1140 



IMS 



1150 



*****«*fiin 1 7 s - 1 - 1 « 



lies 



17 4-4CA <12.j2.k)©*t*SI 
&©7V-Xs«fciOS1-*. 



1 5] 



1 7] 



•4 



1060 



Hi 5 



1200 



7a v 17 5-3 »**» 1 « ? ^ wr. * 

Z 1205 



70^ h»hm 17 6-3 25~i??9? ^^giii?* 



1210 



FUG = 0 



^ 1215 



l-l.IXAX 



1235 
FUS * 1 / 



1220 



Wttr-TVH 7 6-4©5^i©«««2»5)jas« 
TlZzT 



<K-IS+l)*(TI-YS+l»tk4 
AliA >th5 



I 



TUB ' 



1230 



aoMMtie l-3*Uttf1-« 



1240 



.A 



1245 



c»#att _ 



4 



mm* 1 7 3 taw lt, 220 ^fcgffT] 



1255 



DDI 7 



«a«aiHRisw 174- 












k-i.»|£i 





1410 



1429 



7 U— **#E#1 
lT4-3<©jj»(i.j 1 



1425 



*#©7V<-.K*5ESI 17 4-4© 
rajl 7 4-3CD*(lJ»k}®*®** 



; 1430 



1435 



WAKU16 



r 



BVA1 



1440 



1445 

(FE1I0D fVAL)X)/ 



«KW1 T4-3 

«jMl.j.»toe 
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«MJB 2 0 0 1 - 1 8 6 5 1 1 



m 1 6i 



H16 



10TQ 




1310 



^-7 haawfiruv f <i.j> 



1315 



U-C, iCttHIGHTtettf*. 



1320 



W7 f/^/7r 1 7 6-2©^7Va 



(HBIfflT > till ft LIPPU <th2)/ 
(SDK>th3>fr? \ 





(J-l)*jr+l 


ji- 




lt = 




it ■ 





1330 



ftMKttft 17 5-1 a)jft(i2, jZ)<9« 



1345 
1355 



*M«1 7.4-2* 
lft(12.JZ)e>ttfrVtfrv4 



1 74-2®jft(i«,J2,k)fcX7J«*l 7 3 £ 

<© AC .E„i2.k)g>mit<ttirfct:gg-r^ K ^ 1365 



1360 



(72)5S*B# fitS JW3 

IlOK*H«^^IWS-5r»-T1280»«J 



F#-A(#3f) 5C053 FA11 GA20 GB07 GB19 JA22 
KA22 KA24 KA30 
5C054 FC01 FC12 FC13 FC15 FC16 
GA01 GB05 GB12 G004 GD09 
HA18 

5C059 KK00 LA00 SS06 SS11 SS20 
5C084 AA01 AA06 BB04 BB21 CC19 
DD12 GG42 GG43 GG52 GG56 
GG57 GG65 GG78 GG80 
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